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(54) Graphical method of Indicating the position of and performing an operation on a plurality of selected 
objects in a computersystftm. 



i Disclosed is a method of indicating the posi- 
tion of multiple selections of objects in a win- 
dowed computer user interlace. The method 
includes displaying objects to be selected in a 
window which includes a scrofl bar. When 
objects in a the window are selected, a marker 
toon is automatically placed in the scroll bar in 
response to such selection. 
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1 EPO 

The present invention relates generally to win- 
dowed computer user interfaces, and more particu- 
larly to a graphical interface that supports direct 
manipulation of objects. 

In windowed computer user Interfaces, the user 
may select objects to act upon. Selection Is the act of 
marking a choice. The user may select 0, 1, or more 
objects. A user may also scroll the window, causing 
items to appear and disappear from direct view. Dur- 
ing scrolling, a user's selection may no longer be 
Immediately visible. Subsequent actions can affect 
selections, even though the selected objects are not 
visible. 

If a user selects more than one object, it may not 
be possible to see all selections simultaneously. For 
example, in a large list of items it may not be possible 
to view simultaneously the first and last item of the list 
Thus, If these two items are selected, it will not be 
possible to view both selections at once. Here the 
user is forced to remember what the other selections 
are, since they cannot be all viewed at the same time. 

A typical user task Involves scrolling information 
and selecting a number of objects or items on which 
to perform an action. For example, the user may scroll 
a list of mail received and select individual mall items 
to print Conventional user interface designs allow 
direct manipulation of a selected item to be inter- 
prated as manipulating all selected items. 

Unfortunately, when scrolling to the end of a large 
list, unless the user has selected one of the items at 
the very end of the list to print cu men t systems require 
the user to scroll back to a selected Item before direct 
manipulation can be used to print the selected items. 

Also, In current implementations, the user does 
not Know where the selected objects are when they 
have been scrolled out of sight. In order to review the 
selections the user must scroll slowly through the data 
until he or she finds the selected objects. 

In the present invention, a scroll bar is positioned 
in the window for an application. When the user 
selects an object in the window, a marker icon is auto- 
matically placed in the scroll bar in response to the 
selection. As the user scrolls the window through the 
data and makes additional selections, a marker icon 
Is placed in the scroll bar to indicate the position of 
each additional selection. The scroll bar includes a 
slider box that indicates where in the data the window 
Is positioned. The user can thus know where the 
selections are with respect to the current window view 
and can immediately view individual selections by 
clicking the mouse or similar pointing device on each 
marker. Alternately, the user may drag the slider box 
to the marker to view the given selection. If the user 
deselects an object, the marker icon for the object is 
deleted. 

In the present invention, the user can perform an 
action on the selected objects by direct manipulation. 
The user does so by dragging a marker icon out of the 
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scroll bar to a target object. In the preferred embodi- 
ment when the user drags the marker out of the scroll 
bar. the system automatical ly displays a selection coi- 
lectton Icon that represents the selected objects. 

s Figure 1 is a pictorial view of a window entitled 

"Workplace-Daily". 

Figure 2 is a pictorial view similar to Figure 1 in 
which a window entitled "Folder-Project X* has been 
opened and the object entitled "Document T has 

10 been selected. 

Figure 3 is a pictorial view similar to Figure 2 in 
which the ToWer-Project X" window has been scrol- 
led and the object entitled "Chart 19* has been selec- 
ted. 

15 Figure 4 is a pictorial view similar to Figure 3 In 

which the "Folder-Project X" window has been been 
scrolled and the object entitled "Document 31" has 
bean selected. 

Figure 5 is a pictorial view similar to Figure 4 

20 showing direct manipulation of the selection collection 
object loon. 

Figure 6 is a flowchart of the initialization routine 
of die present invention. 

Figure 7 is a flowchart of a preferred software 
23 implementation of the present Invention. 

Figure 8 is a flowchart showing details of the "UP- 
DATE" routine of Figure 7. 

Figure d Is a flowchart showing details of the 
"DRAG" routine of Figure 7. 
30 Figure 10 is a flowchart showing an Implemen- 

tation of the "DROP" routine of Figure 7. 

Figure 1 1 is a flowchart showing an implemen- 
tation of the "SCROLL" routine of Figure 7. 

Figure 12 is a flowchart showing an implemen- 
ts tation of the "SCROLL TO SELECTION" routine of 
Figure 7. 

Referring now to the drawings, and first to Figure 

I, a window Is designated generally by the numeral 

II. Window 11 includes a border or frame 13 that 
40 forma the outer boundary of the window. Contained 

within border 13 are a title bar 15 and an action bar 
17. The remainder of window 11 consists of a client 
area 19, which is populated with a plurality of icons, 
including a folder icon 21 , which is labeled "Project X". 

45 and a printer icon 23. 

Title bar 1 5 includes a window title 25, which iden- 
tifies the window, a system menu Icon 27, and window 
sizing icons 29. System menu icon 27 allows the user 
to display a pull-down menu containing actions that 

so the user can perform on the window. Such actions are 
related to the window Itself and not to the object that 
is displayed in the window. For example, actions 
include MOVE, which arjows the user to reposition the 
window on the screen, MINIMIZE, which reduces the 

55 size of the window, and MAXIMIZE, which enlarges 
trie window to the size of the screen. Window-sizing 
icons 29 provide a fast way to use a mouse or pointing 
device to perform the actions of MINIMIZE and 
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3 EPO 

MAXIMIZE without requiring a menu. 

Action bar 1 7 contains a list of actions of the appli- 
cations shown in the window. Each action in the Net 
in action bar 17 has an associated pull-down menu 
that lists the individual actions that are contained 
within each general action listed in action bar 17. For 
example, the FILE pull-down enables the user to work 
with files through actions that manipulate the file as a 
whole. The individual actions contained within the 
FILE action include NEW, which allows users to 
create a new file, and SAVE, which writes the existing 
file to a storage device. 

A pointer 30 is movable by the user by means of 
a mouse (not shown). The user can move pointer 30 
about the screen and, by means of the mouse buttons, 
select objects, open windows, directly manipulate 
objects, and perform other operations. In Figure 1, fol- 
der 21 is shown emphasized highlighted by means of 
a grey box 28. The emphasis Indicates that folder 21 
has been selected. The selection la made by position- 
ing pointer 30 on folder 21 and clicking mouse button 
number one. The selected object ie available for 
action. 

Turning now to Figure 2, there is shown in addi- 
tion to window 11, an object window 31. Object win- 
dow 31 contains the contents of the "Project X" folder 
represented by Icon 21. Window 31 wae opened by 
choosing the "Open" option from the pull-down menu 
associated with the "File' action of action bar 1 7 . Win- 
dow 31 could also have been opened by placing 
pointer 30 on folder 21 and double clicking mouse but- 
ton number one. 

Window 31 is similar to window 11 In that it 
includes a frame 35, a title bar 37, an action bar 39, 
and a client area 41 that Is populated with a plurality 
of document and chart icons. Window 31 also 
includes a scroll bar43 f which allow the user, In effect, 
to move window frame 35 to view the contents of the 
object within cfisnt area 41. Scroll bar 43 contains a 
slider box 47, which represents the position and sUe 
of the visible information in relation to all the infor- 
mation that Is available. For example, if slider box 47 
is one-third of the way down from the top of scroll bar 
43. the portion of information the user sees is one- 
third of the way down from the top of the information. 

As indicated by emphasis box 28, "Document 2" 
icon 53 has been selected. Document icon 53 was 
selected by placing pointer 30 thereon and clicking 
mouse button number one. When icon 53 was selec- 
ted , a marker icon 49 was placed automatically in 
scroll bar 43 inside slider box 47. Marker ioon 49 indi- 
cates that a selection has been made near the top of 
the data. 

Referring now to Figure 3, window 31 has been 
scrolled to make visible additional Items in client area 
41. Slider box 47 indicates that window 31 has been 
scrolled to a position approximately midway between 
its top and bottom. Emphasis box 28 indicates that the 
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icon 63 for the object entitled "chart 19" has been 
selected. Again, a marker ioon 49a has been placed 
in scroll bar 43 within slider box 47 to indicate the 
selection of icon 55. Marker icon 49 remains visible. 

5 Thus, the user can tell at a glance that two selections 
have been made and their positions in the data. 

Referring to Figure 4, window 31 has been scrol- 
led to the bottom of the data. An additional selection 
has been made, as indicated by the emphasis box 28 

1Q on document ioon 61. As in the previous examples, 
the selection of icon 61 is also indicated by marker 
loon 49b, which has been displayed in scroll bar 43 
within slider box 47. The user thus knows that three 
selections have been made and he or she can review 

16 the selections by moving pointer 30 to one of the mar- 
kers and clicking mouse button number one, which 
will scroll the window 31 to view the selected object 
Figure 5 depicts the direct manipulation of a 
selection collection object Icon 51 to print the selected 

20 objects. Selection collection object icon 51 is created 
by moving printer to one of the markers and holding 
down mouse button number two while dragging the 
marker out of scroll bar 47. When the marker Is 
dragged out of scroll bar 47. icon 51 is displayed on 

25 the screen. Selection collection abject Icon 51 Is 
directly manipulated by dragging it to printer icon 23. 
When selection collection object Icon 51 Is dropped 
on printer icon 23, the selected documents and charts 
will be printed. 

30 Turning now to Figures 6-12, there is shown 

flow-charts of a preferred software implementation of 
the present invention. Referring first to Figure 6, a pro- 
gram is selected at block 63. Upon selection, the pro- 
gram and addressing pointers are loaded and storage 

35 is opened at block 65. Then, in block 67, the window 
frame is constructed. After the window frame has 
been constructed, the window data for the selected 
program Is obtained at block 69 and the window 
Image Is constructed at block 71. Then, the data for 

40 the window Is loaded at block 73, the mouse pointer 
is fetched at block 75, and the data and the mouse 
pointer are displayed in the window at block 77. 

Referring now to Figure 7, after the window has 
been constructed and the data is displayed therein, 

45 the Input is monitored at block 79. As shown at deci- 
sion block 81, If the user makes a selection, the sys- 
tem monitors the pointer or cursor at block 83 and 
provides selection emphasis at block 85. Referring for 
example to Figure 5, selection 

50 emphasis consists of putting a grey box 28 over the 
selected object Then, referring again to Figure 7, the 
system performs UPDATE, which is generally indi- 
cated at block 87. 

Referring particularly to Figure 8, which shows 

55 details of a preferred implementation of the UPDATE 
routine of the present invention, the relative position 
of the selection is located in the scroll bar or slider box 
at block 89. Then, at block 91, the type of object selec- 
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ted is determined and, at block 93, an icon symbol for 
that object type is obtained. Then, an icon of the 
appropriate size and emphasis is constructed at block 
95 and the display buffer for the scroll bar and slider 
box is obtained at block 97. The system tests at deci- 
sion block 99 whether there are other selections to 
Keep; if there are not, the current scroll bar and slider 
box is erased at block 101 and the display buffer is 
refreshed with the icon symbol of the selection at 
block 103. If there are other selections, the selections 
are saved in the display buffer at block 105, and the 
new selection is fit into the display buffer at block 107. 
Then, the updated window Is re-displayed at Nock 
1 09 and the system returns to block 79 of Figure 7 and 
continues to monitor the input. 

Referring again to Figure 7, If, at decision block 
110, ths user desires to initiate a DRAG of the selec- 
ted objects as a group, as shown in and described 
with respect to Figure 5, the system performs the drag 
routine, which is Indicated generally at 1 11. Referring 
particularly to Figure 9, in the DRAG routine the sys- 
tem tests at decision block 113 whether or not there 
are existing selections; if not, error feedback is pro- 
vided to the user at block 1 1 5 and the system returns 
to block 79 and continues to monitor user input. If 
there are existing selections, then the scroll bar and 
slider box are scanned and the selections are counted 
at block 1 1 7. Then an teen frame is built at block 1 1 9 
and a selection icon, which is a composite graphic 
image of tha icons within the scroll bar and slider box, 
($ built at block 1 21 . Then, the window client area dis- 
play buffer Is fetched at block 123 and updated with 
the selection cursor attached to the selection icon in 
block 125. Then, the updated window ts redisplayed 
at block 127 and the system returns to continue moni- 
toring input at block 79. 

Referring again to Figure 7, If at decision block 
129, the user drops the selection icon, then the sys- 
tem performs the DROP routine which Is generally 
indicated at 131. A preferred software Implementation 
of the DROP routine ts shown in Figure 10. As shown 
at block 133. all selected information is moved or 
copied at the drop point The system testa at block 1 35 
whether the action is a MOVE. If it is, all selections are 
removed from the scroll bar or slider box at block 1 37. 
Then the data buffer is updated at block 139 to reflect 
the MOVE or COPY operation on the data and the 
updated window is re-displayed at block 141. Then, 
tha system returns to block 79 and continues to moni- 
tor user input 

Referring again to Figure 7, if t at decision block 
143. the user scrolls the window, the system performs 
the SCROLL routine which Is Indicated generally at 
145 and shown in detail in Figure 1 1 . First the window 
display buffer is fetched at block 147. The system 
tests at decision block 149 whether or not there are 
any selections. If there are, the scroll bar and slider 
box are scanned for selections at block 151 and tha 
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scroll bar/slider box selections and positions are 
saved at block 1 53. Next, the updated slider box posi- 
tion is determined at block 155. The window client 
area display buffer is fetched at block 1 57 and the dis- 

6 play buffer is updated for the new slider box position 
at block 1 59. Also, me display buffer Is updated for the 
new scroll bar selections at block 161 and the display 
buffer is updated for the new data in the client area at 
block 163. Then, the updated window is re-displayed 

10 at block 165 and the system returns to block 79 of Fig- 
ure 7 and continues to monitor user input 

The present Invention allows the user to review 
the selections made by pointing to the selection mar- 
ker icons in the scroll bar or slider box and scrolling 

15 to them by clicking mouse button number one the* 
reon. rf, at decision block 167, the user makes a selec- 
tion in the scroll bar or slider box, the system performs 
the SCROLL TO SELECTION routine indicated gen- 
erally at 169 and shown in detaa in Figure 12. Refer- 

20 ring to Figure 12, the marker icon position is matched 
to the selection in the client area at block 171 and the 
scroll bar selections and positions are saved at block 
173. Then, the window client area display buffer is 
fetched at block 175. After the window client area dls- 

?5 play buffer has been fetched, the display buffer Is 
updated for the new slider box position at block 177, 
the display buffer to updated for the scroll bar selec- 
tions at block 179. and the display buffer is updated 
for new data in the client area at block 181 . Then, the 

so updated window is re-displayed at block 183 and the 
system returns to block 79 of Figure 7 to continue 
monitoring user input As shown generally at block 
185 of Figure 7, other actions may be performed. 
Tha present invention allows the user to sea at a 

35 glance how many selections have been made and to 
review those selections quickly and easily. The pre- 
sent invention also allows the user to perform oper- 
ations on the selections as a group by direct 
manipulation. 

40 WhH a the Invention has been particularly shown 

and described with reference to a preferred embodi- 
ment, those ski led In the art wHI understand that vari- 
ous changes may be made in form and detail without 
departing from the spirit and scope of the invention. 

46 

Claims 

1. In a computer system that includes a display 
60 screen and a user operable means for manipulat- 

ing objects on said screen, a method of indicating 
the position of multiple selections of objects In a 
windowed computer user interface, which com- 
prises the steps of: 
66 displaying objects to be selected in a window, 

said window Including a scroll bar, 
selecting an object in said window; and, 
automatically placing a marker icon in said scroll 
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bar in response to selecting eaW object 

2. The method as claimed In claim 1, Including the 
steps of: 

scrolling said window to display in said window 5 
additional objects to be selected; 
selecting one of said additional objects; and, 
automatically placing a second marker Icon In 
said scroll bar in response to selecting said 
additional object. 10 

3. In a computer system that includes a display 
screen and useroperable means for manipulating 
objects on said screen, a method of performing 

an operation on a plurality of selected objects In 13 
a windowed computer user interface, which com- 
prises the steps of: 

playing a portion the objects to be selected In a 
window, said window including a scroll ban 
selecting an object displayed in said window; and 20 
automatically placing a marker icon In saW scroll 
bar in response to selecting said object 

4. The method as claimed in claim 3, including the 
steps of: 25 
scrolling said window to display in said window a 
different portion of the objects to be selected; 
selecting an object from said different portion; 
and, 

automatically placing a second marker icon in 30 
said scroll bar response to selecting said object 
from said different portion. 

5. The method as claimed in claim 4, including the 
step of: 35 
dragging one of said marker Icons to a target 
object to perform an action on said selected 
objects. 

6. The method as claimed in claim 5, including the 40 
step of. 

automatically displaying a selection collection 
icon in response to dragging said marker icon. 

7. The method as claimed In claim 3, including the 45 
steps of: 

automatically removing a marker icon from said 
scroll bar in response to deselecting said object 
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